Graphical user interface device

ABSTRACT

In one embodiment, a graphical user interface device comprises an image display device configured to display an operation window including a first operation area which corresponds to a first area and a second operation area which corresponds to a second area. An allocation unit is configured to allocate the graphical user interface device to the first operation area, and to allocate one of a plurality of participant devices to the second operation area. A controller is configured to control a projector to display the combined image in which a first image, that corresponds to the image display device of the graphical user interface device, is displayed in the first area and in which a second image, that corresponds to a participant device allocated to the second operation area, is displayed in the second area.

CROSS-REFERENCE TO RELATED APPLICATIONS

The present application is a continuation application of U.S. patentapplication Ser. No. 12/186,955 filed on Aug. 6, 2008, which claimspriority from Japanese Patent Application No. 2007-205653 filed on Aug.7, 2007, which are hereby incorporated by reference in their entirety.

BACKGROUND

Recently, a conference system that connects plural personal computersand a projector has been developed. Such a conference system enablessimultaneous projection of display screens of plural personal computersby split display. This is convenient for a conference or a lesson whereusers want to have a discussion while comparing reference data saved inplural personal computers. For example, conference systems disclosed inJapanese Patent Publication Nos. JP-A-2004-54134 and JP-A-2003-330436are known.

JP-A-2004-54134 discloses a technique in which a projector combinescaptured images on the screens of plural terminals connected via anetwork and projects these images on one split display screen. In thissplit display, which terminal image should be allocated to which ofsplit areas that form the split display screen, is decided in accordancewith a priority order of terminals inputted by the user using a remotecontroller or the like.

Inputting the priority order of terminals and allocating terminal imagesto the split areas in this manner may be a troublesome operation for theuser. In the case where there are a large number of images to becandidates for split display and the allocation is changed many times,the operation may become even more troublesome. Moreover, the user mustremember the position of split areas corresponding to the priorityorder. The challenges of such operation is not limited to the case ofusing the priority order. Challenges may similarly occur in the case ofallocating terminal images by designating split areas that form a splitdisplay screen.

SUMMARY

In certain embodiments, an operation such as allocating a predeterminedimage to each of split screen forming areas that form a split screen inan image display apparatus capable of displaying images on a splitscreen may be easily carried out.

According to at least one embodiment, a graphical user interface devicethat allocates, in an image display apparatus capable of displayingimages on a split screen, a predetermined image to each of split screenforming areas that form the split screen, includes a unit that displaysan operation window having the same number of operation areas as thenumber of splits of the split screen, each of the operation areas beingunivocally associated with each of the split screen forming areas.

In the graphical user interface device having such a configuration, theoperation window having operation areas, each of which may be univocallyassociated with each of the split screen forming areas that from thesplit screen, may be displayed. As such, if an operation is carried outby using an operation area corresponding to a split screen forming areawhere the user wants to carry out the operation, it is not necessary tocarry out an operation to select a split screen forming area in whichthe operation should be carried out. Thus, an operation with respect tothe split screen forming areas may be more easily carried out.

In the graphical user interface device, the operation areas may bearranged in the same positional relation as the layout of the splitscreen forming areas.

In the graphical user interface device having such a configuration,since the operation areas are arranged in the same positional relationas the layout of the split screen forming areas, which operation area isassociated with which split screen forming area may be understoodvisually and more easily. Therefore, an operation with respect to thesplit screen forming areas may be more easily carried out.

In the graphical user interface device, each of the operation areas mayhave a unit that allocates a predetermined image to the correspondingsplit screen forming area.

In the graphical user interface device having such a configuration,since each of the operation areas has a unit that allocates apredetermined image to the corresponding split screen forming area,allocation of an image may be more easily carried out by feweroperations, using the operation area corresponding to the split screenforming area to which the user wants to allocate an image.

In the graphical user interface device, each of the operation areas mayhave a unit that switches display of the split screen and full-screendisplay for displaying one of the split screen forming areas on a singlenon-split screen.

In the graphical user interface device having such a configuration,since each of the operation areas has a unit that switches display ofthe split screen and full-screen display, if an instruction to switchfrom split screen display to full-screen display is carried out in theoperation area corresponding to the image which the user wants to see byfull-screen display, it is not necessary to carry out an operation toselect the image which the user wants to see by full-screen display. Assuch, the form of display may be more easily switched to full-screendisplay by fewer operations.

In the graphical user interface device, each of the operation areas mayhave an allocation unit that allocates a predetermined image to thecorresponding split screen forming area, and a switching unit thatswitches display of the split screen and full-screen display fordisplaying one of the split screen forming areas on a single non-splitscreen. The allocation unit is capable of allocating a predeterminedimage while the switching unit is switching from the display of thesplit screen to the full-screen display to display an image of thefull-screen display on the display apparatus.

In the graphical user interface device having such a configuration, theallocation unit can allocate a predetermined image while the switchingunit is switching from the display of the split screen to thefull-screen display to display an image of the full-screen display onthe display apparatus. Therefore, at the time of switching the imagefrom the full-screen display to the display of the split screen, nowaiting time is generated in the operation to allocate images to thesplit screen forming areas. As such, it is possible to more smoothlyswitch the display of the split screen and the full-screen display.

In the graphical user interface device, each of the operation areas mayhave a unit that displays in the operation area a thumbnail of an imagedisplayed in the split screen forming area corresponding to theoperation area.

In the graphical user interface device having such a configuration, ineach of the operation areas, the thumbnail of the image displayed in thesplit screen forming area corresponding to the operation area may bedisplayed. As such, the corresponding relation between the split screenforming areas and the operation areas may be more easily understood andan operation with respect to the split screen forming areas may be moreeasily carried out.

The graphical user interface device may further include a unit thatchanges the number of splits in the split screen and/or layout of thesplit screen forming areas, and a unit that changes the number of splitsin the operation window and/or its layout in accordance with the changednumber of splits and/or layout.

In the graphical user interface device having such a configuration, ifthe number of splits in the split screen and/or the layout of the splitscreen forming areas is changed, the number of splits in the operationwindow and/or its layout may be changed in accordance with that change.As such, whatever number of splits and layout in the split screen isset, an operation with respect to the split screen forming areas may bemore easily carried out. Moreover, even if the number of splits andlayout in the split screen is changed in the course of processing, anoperation with respect to the split screen forming areas may be moreeasily carried out.

According to at least one embodiment, a graphical user interface devicethat allocates, in an image display apparatus capable of displayingimages on a split screen, a predetermined image to each of split screenforming areas that form the split screen, includes a unit that displaysan operation window including plural operation areas having a visuallyrecognizable corresponding relation with each of the split screenforming areas.

In the graphical user interface device having such a configuration, anoperation may be carried out by using the operation window includingoperation areas having a visually recognizable corresponding relationwith each of the split screen forming areas. As such, by operating theoperation area corresponding to a desired split screen forming area, itis possible to more easily carry out an operation with respect to thesplit screen forming areas.

BRIEF DESCRIPTION OF THE DRAWINGS

Various embodiments of the disclosure are described with reference tothe accompanying drawings, wherein like numbers refer to like elements.

FIG. 1 illustrates the configuration of a conference system.

FIG. 2 illustrates the schematic configuration of participant computers.

FIG. 3 illustrates the schematic configuration of a moderator computer.

FIG. 4 illustrates the schematic configuration of a projector.

FIG. 5 is a flowchart illustrating a flow diagram on the side of theparticipant computers, of connection processing between the participantcomputers and the moderator computer.

FIG. 6 is a flowchart illustrating a flow diagram on the side of themoderator computer, of connection processing between the participantcomputers and the moderator computer.

FIG. 7 illustrates a specific example of an hourly profile.

FIG. 8A and FIG. 8B illustrate a specific example of an hourly profileand a class makeup profile.

FIG. 9 illustrates an exemplary flow diagram of split display screenswitching processing to switch a display image by using the conferencesystem in accordance with certain embodiments.

FIG. 10 illustrates an exemplary flow diagram of split display screenswitching processing to switch a display image by using the conferencesystem in accordance with certain embodiments.

FIG. 11 illustrates an example of a projector selection window to carryout setting of a projector and a screen display.

FIG. 12 illustrates an example of a projector projection operationwindow to perform a projector projection operation.

FIG. 13 illustrates an exemplary display where the projector projectionoperation window is being used.

DESCRIPTION OF EMBODIMENTS

In the following description, reference is made to the accompanyingdrawings which form a part hereof, and in which are shown, by way ofillustration, specific embodiments in which the disclosure may bepracticed. It is to be understood that other embodiments may be utilizedand structural or logical changes may be made without departing from thescope of the present disclosure. Therefore, the following detaileddescription is not to be taken in a limiting sense, and the scope of thepresent disclosure is defined by the appended claims and theirequivalents.

Throughout the specification and claims, the following terms take atleast the meanings explicitly associated herein, unless the contextclearly dictates otherwise. The meanings identified below are notintended to limit the terms, but merely provide illustrative examplesfor use of the terms. The meaning of “a,” “an,” “one,” and “the” mayinclude reference to both the singular and the plural. Reference in thespecification to “one embodiment” or “an embodiment” means that aparticular feature, structure, or characteristic described in connectionwith the embodiment may be included in at least one embodiment of thedisclosure. The meaning of “in” may include “in” and “on.” Theappearances of the phrases “in one embodiment” or “in an embodiment” invarious places in the specification do not necessarily all refer to thesame embodiment, but it may.

Several embodiments will sequentially be described under correspondingsection headings below. Section headings are merely employed to improvereadability, and they are not to be construed to restrict or narrow thepresent disclosure. For example, the order of description headingsshould not necessarily be construed so as to imply that these operationsare necessarily order dependent or to imply the relative importance ofan embodiment. Moreover, the scope of a disclosure under one sectionheading should not be construed to restrict or to limit the disclosureto that particular embodiment, rather the disclosure should indicatethat a particular feature, structure, or characteristic described inconnection with a section heading is included in at least one embodimentof the disclosure, but it may also be used in connection with otherembodiments.

Various operations will be described as multiple discrete stepsperformed in turn in a manner that is most helpful in understanding theprinciples described herein. However, the order of description shouldnot necessarily be construed so as to imply that these operations arenecessarily order dependent. In particular, these operations may notneed to be performed in the order of presentation, but they may.

Many of the functional units described in this specification have beenlabeled as units in order to more particularly emphasize theirimplementation independence. For example, a unit may be implemented as ahardware circuit comprising custom VLSI circuits or gate arrays,off-the-shelf semiconductors such as logic chips, transistors, or otherdiscrete components. A unit may also be implemented in programmablehardware devices such as field programmable gate arrays, programmablearray logic, programmable logic devices or the like.

Units may also be implemented in software for execution by various typesof processors. An identified unit of executable code may, for instance,comprise one or more physical or logical blocks of computer instructionswhich may, for instance, be organized as an object, procedure, orfunction. Nevertheless, the executables of an identified unit need notbe physically located together, but may comprise disparate instructionsstored in different locations which, when joined logically together,comprise the unit and achieve the stated purpose for the unit.

Indeed, a unit of executable code may be a single instruction, or manyinstructions, and may even be distributed over several different codesegments, among different programs, and across several memory devices.Similarly, operational data may be identified and illustrated hereinwithin units, and may be embodied in any suitable form and organizedwithin any suitable type of data structure. The operational data may becollected as a single data set, or may be distributed over differentlocations including over different storage devices, and may exist, atleast partially, merely as electronic signals on a system or network.

A. Configuration of Conference System A-1. Schematic Configuration ofSystem

FIG. 1 illustrates the configuration of a conference system 10 accordingto at least one embodiment. The conference system 10 is an image displaysystem that enables a projector to simultaneously display an image onthe display screens of plural terminals. The conference system 10includes computers PC1 to PC5, a moderator computer PCm and a projectorPR1 connected via a network. In at least one embodiment, the computersPC1 to PC5, the moderator computer PCm and the projector PR1 areconnected via a local area network LAN. Although not shown, otherdevices equivalent to the moderator computer PCm and the projector PR1are installed on the local area network LAN.

The method of connecting the computers PC1 to PC5, the moderatorcomputer PCm and the projector PR1 is not, however, limited to the aboveform. Various connection methods can be set in accordance with theenvironment where these devices are used, required communication speed,and so on. For example, the moderator computer PCm and the projector PR1can be locally connected by a D-sub cable or USB cable. Moreover, theseconnections are not limited to wired connections but may be wirelessconnections. Furthermore, these devices can be connected via theInternet.

As will be described in more detail later, the projector PR1 can projectand image on a screen SC1 and the moderator computer PCm can display acombined image formed as a result of combining four difference imagesinto one screen image. Hereinafter, the areas corresponding toquadrisected displays on the screen SC1 are referred to as split screenforming areas SC11 to SC14, as shown in FIG. 1.

A-2. Schematic Configuration of Computers

The computer PC1 of the conference system 10 is a personal computerhaving a predetermined program installed therein and is provided to beused by a student A. FIG. 2 shows a schematic configuration of thecomputer PC1. The computers PC2 to PC5 provided to be used by students Bto E have a configuration similar to that of the computer PC1 andtherefore will not be described further in more detail. As shown in FIG.2, the computer PC1 has a CPU 20, a hard disk drive 30, a ROM 36, a RAM38, a network interface 41, an input system 51, a VRAM 61, a graphiccontroller 63, and a display 65, which are connected to each other by abus.

The CPU 20 expands firmware and OS stored in the hard disk drive 30 andthe ROM 36 into the RAM 38 and executes these, thereby controlling thecomputer PC1. The CPU 20 also executes a program stored in the hard diskdrive 30 and as such functions as a data transmitting unit 21 and acommunication unit 22. This functional part will be described in moredetail later.

In the hard disk drive 30, the IP address of the computer PC1 is storedand also storage areas for storing an address/server name managementtable 31, a server name profile 32 and an hourly profile 33 are secured.These parts will be described in more detail later. These storage areasare not limited to the hard disk drive 30 and can be secured in anEEPROM, which is a rewritable non-volatile memory.

The network interface 41 is an interface for connection to the localarea network LAN. The computer PC1 is connected to the local areanetwork LAN via the network interface 41.

The input system 51 includes a keyboard and a pointing device (here, amouse). The graphic controller 63 displays an image to be displayed onthe display 65 by using the VRAM 61 as a buffer.

A-3. Schematic Configuration of Moderator Computer

The moderator computer PCm is a personal computer having a predeterminedprogram installed therein and is provided to be used by a teacher M. Inat least one embodiment, this moderator computer PCm is equivalent to aserver. FIG. 3 illustrates a schematic configuration of the moderatorcomputer PCm. As depicted in FIG. 3, the moderator computer PCm has aCPU 70, a hard disk drive 80, a ROM 86, a RAM 88, a network interface91, a USB interface 93, an input system 101, a VRAM 111, a graphiccontroller 113, and a display 115, which are connected to each other bya bus.

The CPU 70 executes a program stored on the hard disk drive 80 and thusfunctions as a data communication control unit 71, an image combiningunit 72, a combined image accepting unit 73, an image switchingaccepting unit 74, a GUI control unit 75, and a communication unit 76.

In the hard disk drive 80, the IP address of the moderator computer PCmis stored and also storage areas for storing an address/client namemanagement table 81, a client name profile 82, an hourly profile 83 anda class makeup profile 84 are secured. Also plural GUI programs arestored, which will be described later. These parts will be described inmore detail later. These storage areas are not limited to the hard diskdrive 80 and can be secured in an EEPROM, which is a rewritablenon-volatile memory.

The USB interface 93 is a USB-style interface for connection to theprojector PR1. The moderator computer PCm can be connected to theprojector PR1 via a USB cable.

The ROM 86, the RAM 88, the network interface 91, the input system 101,the VRAM 111, the graphic controller 113 and the display 115 have thesame configuration as in the computers PC1 to PC5 and therefore will notbe described in further detail.

A-4. Schematic Configuration of Projector

The projector PR1 of the conference system 10, is a versatile projectorwithout having any special function for split screen display. FIG. 4illustrates a schematic configuration of the projector PR1. As depictedin FIG. 4, the projector PR1 has a CPU 120, a ROM 136, a RAM 138, anetwork interface 141, a USB interface 143, a VRAM 151, a graphiccontroller 153, and a projecting unit 155, which are connected to eachother by a bus.

The CPU 120 expands a program stored in the ROM 136 into the RAM 138 andexecutes the program, thereby functioning as a data receiving unit 121.This functional part will be described in further detail later.

The network interface 141 is an interface for connection to the localarea network LAN. The projector PR1 is connected to the local areanetwork LAN via the network interface 141. The USB interface 143 is aUSB-style interface for connection to the moderator computer PCm. Theprojector PR1 can also be connected to the moderator computer PCm via aUSB cable.

The graphic controller 153 causes the projecting unit 155 to display animage by using the VRAM 151 as a buffer. The projecting unit 155 is aliquid crystal projection mechanism. By projecting light transmittedthrough a liquid crystal panel for RGB, the projecting unit 155 displaysan image on the screen SC1. Although a liquid crystal system isdisclosed in this embodiment, it is not limited to such as various othersystems may be used such as a CRT system, DLP system, LCOS system or GLVsystem.

B. Method of Using Conference System

At least one method of using the conference system 10 will be describedin more detail based on the conference system 10 being used for a lessonat a school. In the following example, it is assumed that a teacher M,who is a facilitator of the lesson, carries out a lesson by operatingthe moderator computer PCm to carry out full-screen display of one ofdisplay screen images PCT1 to PCT5 displayed on the displays 65 of thecomputers PC1 to PC5 used by students A to E and a display screen imagePCTm displayed on the display 115 of the moderator computer PCm, orsplit screen display of selected display screen images of the displayscreen images PCT1 to PCT5 and PCTm, onto the screen SC1 via theprojector PR1. The display screen images PCT1 to PCT5 and PCTm may beimages showing reference materials prepared by each of the students A toE and the teacher M. The students A to E and the teacher M may explaintheir own prepared reference materials in accordance with the lesson.

B-1. Initial Setting for Use

Initial setting for using the conference system 10 will now bedescribed. Initial setting in this embodiment is for the computers PC1to PC5 and the moderator computer PCm to carry out communications. Thisinitial setting processing is started when the teacher M first starts uppredetermined software in the moderator computer PCm, and then thestudents A to E start up predetermined software in the computers PC1 toPC5, respectively.

When the above software has started up, the CPU 20 of the computers PC1to PC5 issues a search command and simultaneously communicates thesearch command in the local area network LAN. Meanwhile, the CPU 70 ofthe moderator computer PCm, having received the search command, sendsback the computer name (e.g., teacher name) and IP address of themoderator computer PCm to the computers PC1 to PC5. The CPU 20 of thecomputers PC1 to PC5 receives this computer name and IP address andregisters this data to address/server name management table 31.

The CPU 20 of the computers PC1 to PC5 transmits the computer names(e.g., student names) and IP addresses of the computers PC1 to PC5 tothe moderator computer PCm. The CPU 70 of the moderator computer PCmreceives these computer names and IP addresses and registers this datato the address/client name management table 81.

The computers PC1 to PC5 specify the IP address of the moderatorcomputer PCm by referring to the server name profile 32 in which theteacher name has been registered and the above address/server namemanagement table 31, and carry out communications. Similarly, themoderator computer PCm specifies the IP addresses of the computers PC1to PC5 by referring to the client name profile 82 and the address/clientname management table 81, and carries out communications. In at leastone embodiment, such initial setting is carried out every time the abovesoftware is started up in order to address the case where a new studentis added or an IP address is changed. However, the update of thisinitial setting may be omitted in the case where there is no change inregistration contents for a predetermined period. Moreover, the aboveinitial setting may also be input by the teacher M and the students A toE using the input system 51 and the input system 101.

In at least one embodiment, it is assumed that the IP addresses of thecomputers PC1 to PC5 and of the moderator computer PCm are stored on thehard disk drives 30 and 80, respectively, through prior setting by thestudents A to E and the teacher M. However, the IP addresses are notlimited to such a configuration. For example, before the above initialsetting, a DHCP server on the local area network LAN may allocate an IPaddress to each of the computers PC1 to PC5 and the moderator computerPCm in response to an IP address request that is simultaneouslycommunicated from the computers PC1 to PC5 and the moderator computerPCm.

B-2. Connection Processing

FIG. 5 and FIG. 6 show flow diagrams of connection processing betweenthe computers PC1 to PC5 and the moderator computer PCm. FIG. 5 showsprocessing on the side of the computers PC1 to PC5, which is carried outby the CPU 20 as the processing at the communication unit 22. FIG. 6shows processing on the side of the moderator computer PCm, which iscarried out by the CPU 70 as the processing at the communication unit76. In the following example, it is assumed that the students A to Ehave their respective exclusive-use computers PC1 to PC5 allocated.These flow diagrams of processing are started when the above softwarehas started up and initial setting is complete.

As the connection processing is started, first, the CPU 20 of thecomputers PC1 to PC5 read the hourly profile 33 stored on the hard diskdrive 30 as shown in FIG. 5 (step S200).

Turning now to FIG. 7, and with continued reference to FIG. 5, aspecific example of this hourly profile 33 is illustrated. The hourlyprofile 33 is a profile in which a connection destination is set bytime. As illustrated, each of the lessons in the first to fourth periodson Monday through Friday is associated with the name of the teacher incharge of the lesson which the students are to attend. As such, thehourly profile 33 is a lesson timetable for the students A to E. Forexample, the first period on Monday is defined as a lesson of theteacher M, the third period on Tuesday is a lesson of the teacher N, andso on. This hourly profile 33 is inputted in advance by the students Ato E using the input system 51 and so on, and is stored on the hard diskdrive 30.

Having read the hourly profile 33, the CPU 20 compares the present timewith the hourly profile 33 and determines whether there is profile datacorresponding to the present time (step S201).

If there is corresponding profile data as a result of the determination(YES in step S201), a lesson to attend is scheduled in that time period.As such, the CPU 20 requests connection to the computer (in thisembodiment, the moderator computer PCm) of the teacher (in thisembodiment, the teacher M) corresponding to this time period (stepS202). Although not shown in FIG. 1, each of the teachers N to Q shownin FIG. 7 utilizes a moderator computer connected to the local areanetwork LAN, like teacher M. In time periods when other lessons arescheduled, a connection request is made to the computers of the teachersN to Q. Alternatively, if there is no corresponding profile data (NO instep S201), no lesson is scheduled in that time period, and theprocessing ends.

In the moderator computer PCm, when the connection processing isstarted, the CPU 70 reads the hourly profile 83 and the class makeupprofile 84 stored on the hard disk drive 80, as illustrated in FIG. 6(step S221).

Turning now to FIG. 8A, and with continued reference to FIG. 6, aspecific example of the hourly profile 83 is depicted. The hourlyprofile 83 is a profile in which a connection destination is set bytime. As illustrated, each of the lessons in the first to fourth periodson Monday through Friday is associated with the name of the class wherethe teacher gives a lesson in the time period. As such, the hourlyprofile 83 is a timetable of lessons that the teacher M is to give. Forexample, the first period on Monday is defined as a lesson for a class1, the second period on Monday is a lesson for a class 2, and so on.

FIG. 8B shows a specific example of the class makeup profile 84. Theclass makeup profile 84 is a profile in which the makeup of the class asa lesson attendance unit is set. Here, each of the classes 1 to 7 isassociated with the names of students who make up the class.

The hourly profile 83 and the class makeup profile 84 are inputted inadvance by the teacher M using, for example, the input system 101, andis stored on the hard disk drive 80.

Having read the hourly profile 83 and the class makeup profile 84, theCPU 70 continuously determines whether there is a connection requestfrom the students A to E, that is, the computers PC1 to PC5 (step S222).

If there is no connection request as a result of the determination (NOin step S222), the CPU waits until a connection request comes.Alternatively, if it is determined that there is a connection request(YES in step S222), the CPU 70 determines whether the student who hassent the connection request is a student belonging to the classcorresponding to the present time defined in the hourly profile 83, byreferring to the hourly profile 83 and the class makeup profile 84 (stepS223).

If the student belongs to the class as a result of the determination(YES in step S223), the CPU 70 permits connection in response to theconnection request from the student and establishes connection (stepS224). Alternatively, if the student does not belong to the class, thisstudent is not entitled to attend the lesson of this time period. Assuch, the CPU 70 rejects connection in response to the connectionrequest from the student (step S225) and returns the processing to stepS222 to stand by for a new connection request from another student. Inthis manner, the connection between the computers PC1 to PC5 and themoderator computer PCm may be established via the local area networkLAN.

In this embodiment, it is assumed that the students A to E have theirown exclusive-use computers PC1 to PC5. However, in the case wheremultiple students share a computer, the CPU 20 may allow the students toinput their individual student names before the above step S200, and thestudent names may be transmitted together with a connection request tothe moderator computer PCm in the above step S202.

In this embodiment, the profile associating time conditions withconnection destinations is stored in both the computers PC1 to PC5 asterminals, and the moderator computer PCm as a server. However, inalternative embodiments, the profile may be stored only in the computersPC1 to PC5 or in the moderator computer PCm. Even in the embodiment(s)where the profile is stored only in the moderator computer PCm, if thecomputers PC1 to PC5 are configured to automatically and simultaneouslycommunicate a connection request onto the local area network LAN, themoderator computer PCm refers to the hourly profile 83 and the classmakeup profile 84 and gives connection permission only to the computersPC1 to PC5 that match these profiles. As such, it is possible toautomatically establish connection between the computers PC1 to PC5 andthe moderator computer PCm.

In the case of rejecting connection in the above step S225, themoderator computer PCm may be configured to send a notification that theconnection is rejected to the appropriate computers PC1 to PC5 fromwhich the connection is rejected. In this manner, the students A to Emay quickly learn they are not entitled to attend the particular lesson.

B-3. Split Display Screen Switching Processing

FIG. 9 and FIG. 10 illustrate, in accordance with at least oneembodiment, an exemplary flow diagram of split display screen switchingprocessing in which split display images on the display screens of thecomputers PC1 to PC5 are projected on the screen SC1 and the displayimages are switched using the conference system 10. As illustrated, theright column in FIG. 9 and FIG. 10 shows an operation by the teacher Mto designate a display image to be projected on the screen SC1 by usingthe moderator computer PCm. The middle columns in FIG. 9 and FIG. 10show processing by the moderator computer PCm in response to theoperation by the teacher M shown in the right column, and processing bythe computers PC1 to PC5 and the projector PR1 in response to theprocessing by the moderator computer PCm. The left column in FIG. 9 andFIG. 10 shows an image projected on the screen SC1 at each stage of themiddle columns.

This processing is started as the teacher M carries out an operation todesignate a projection image to the moderator computer PCm. In at leastone embodiment, this is a designation operation to cause the projectorPR1 to project an image of quadrisected display including the displayscreen images PCT1 to PCT4 of the computers PC1 to PC4 (operation O360).

The designation of the operation O360 may be carried out using the inputsystem 101 of the moderator computer PCm and a GUI (graphical userinterface) displayed on the display 115. Hereinafter, this GUI will bedescribed with reference to a specific example. In the moderatorcomputer PCm, when the above software is started up, the CPU 70 causesthe display 115 to display a window for selecting a projector and forsetting the screen display, by using the graphic controller 113. As anexample of this window, FIG. 11 depicts a projector selection windowW400. The projector selection window W400 may include a projectorselection sub-window W410 and a screen display setting sub-window W420.

In the projector selection sub-window W410, a list of projectorsconnected to the moderator computer PCm may be shown. The projectors, asshown, have their connections to the moderator computer PCmautomatically recognized by plug-and-play. FIG. 11 depicts the statewhere the projector PR1, of the connected projectors PR1 and PR2, isselected as the projector to be used. Although the projector PR2 is notshown in FIG. 1, this example depicts the embodiment(s) where there isanother projector on the local area network LAN connected by the sameconfiguration as the projector PR1. In the projector selectionsub-window W410, if there are projectors on the local area network LAN,the CPU 70 searches for the projectors at the time of start-up of theabove software and the result of the search is displayed in the abovelist of projectors. However, it may also be possible to re-search forthe connected projectors by, for example, clicking a search button B412.

In the screen display setting sub-window W420, options for displaymethod of an image that the projector PR1 should project onto the screenSC1 are shown. In the example of FIG. 11, full-screen display,two-screen display, and four-screen display are shown as options, and ofthese, the four-screen display is selected. The two-screen display andthe four-screen display are display methods for providing simultaneoussplit display of different images. When one of these display methods isselected, the split display and the full-screen display may be easilyswitched, as will be described in more detail later. The options ofsplit screen display are not limited to the two-screen display and thefour-screen display shown as examples. For example, the split screendisplay may include a three-screen display or a display of five or morescreens. In the two-screen display, various formats of the split screenmay be selected at the same time, such as the layout of the split screensuch as whether two screens are to be arrayed laterally orlongitudinally, and the size of each split screen.

As illustrated, when the projector PR1 and the four-screen display areselected and an OK button B422 is clicked, the CPU 70, in the form ofprocessing at the GUI control unit 75, reads a GUI program correspondingto the selected four-screen display from plural types of GUI programsstored on the hard disk drive 80, and causes the display 115 to displaya projector projection operation window by using the graphic controller113. As an example of this window, FIG. 12 shows a projector projectionoperation window W500. The projector projection operation window W500may include a moderator display sub-window W510, a participant displaysub-window W520, a projection operation sub-window W600, and a previewsub-window W700.

In the moderator display sub-window W510, the name of the predetermineduser of the moderator computer PCm may be shown as the moderator name.In embodiments where multiple users share the moderator computer PCm,the moderator name may be inputted when the software is started up.

In the participant display sub-window W520, a list of computers that areprojectable by the projector PR1 is shown together with their status.The projectable computers include the moderator computer PCm andcomputers having connection established with the moderator computer PCmin the above step S224. As illustrated, for ease in identification, theuser names of the computers are shown as the list of computers. Thestatus in this embodiment refers to information about whether thecomputer is now being projected or not. In the example of FIG. 12, themoderator name “teacher M” is shown in W510 and “teacher M” and“students A to E” of the computers PC1 to PC5 are shown in theparticipant display sub-window W520. The displays in the moderatordisplay sub-window W510 and the participant display sub-window W520 maycontain any information that enables univocal identification of themoderator or participants. Computer names, machine type names and so onmay also be used for these displays.

The projection operation sub-window W600 has a top left screensub-window W610, a top right screen sub-window W620, a bottom rightscreen sub-window W630, and a bottom left screen sub-window W640. Thefour screen sub-windows are provided because “four-screen display” isselected in the screen display setting sub-window W420. If “two-screendisplay” is selected, the number of screen sub-windows is two. If“full-screen display” is selected, the number of screen sub-windows isone. That is, the number and layout of screen sub-windows provided inthe projection operation sub-window W600 correspond to the split displayscreen displayed on the screen SC1. In at least one embodiment, thescreen sub-windows correspond to the number of splits and layout of thesplit display screen. However, the screen sub-windows are not limited tosuch a configuration and may correspond to various display forms of thesplit display screen. For example, in the embodiment (s) where the splitscreen forming areas that constitute the split display screen have ascreen frame in different colors from each other, the color of thescreen sub-windows may correspond to the color of the screen frames. Inanother example, where the split screen forming areas have differentshapes and sizes from each other, the shape and size of the screensub-windows may correspond to the shape and size of the split screenforming areas.

The top left screen sub-window W610 has a projection user display partD611, a projection button B613, a stop button B614, and a full-screendisplay button B615. The projection user display part D611 is an area todisplay the user of the computer corresponding to the image displayed inthe top left split screen forming area (split screen forming area SC11).The projection button B613 and the stop button B614 are operationbuttons that give instructions to project a predetermined image in thetop left split screen forming area independently of the other splitscreen forming areas, and to stop the projection. For example, asillustrated in FIG. 12, if “student A” is selected in the participantdisplay sub-window W520 and then the projection button B613 is clickedin the top left screen sub-window W610, “student A” is displayed in theprojection user display part D611 and the display screen image PCT1 ofthe computer PC1 used by the student A can be displayed in the splitscreen forming area SC11, which is the top left screen part of thescreen SC1. If the stop button B614 is clicked, the display of “studentA” vanishes from the projection user display part D611 and the displayscreen image PCT1 vanishes from the split screen forming area SC11. Theoperation to select “student A” in the participant display sub-windowW520 and to allocate the display screen image PCT1 to the split screenforming area SC11 in the projection operation sub-window W600 may alsobe carried out by drag and drop of “student A” from the participantdisplay sub-window W520 into W610, instead of clicking the projectionbutton B613.

The full-screen display button B615 is a button to switch thequadrisected display screen and the full-screen display. For example, ifthe full-screen display button B615 is clicked in the embodiment wherethe quadrisected display screen is shown on the screen SC1, the imagedisplayed in the top left split screen forming area can be switched tothe full-screen display. Then, as the full-screen display button B615 isclicked again, the full-screen display can be switched to the previousquadrisected display screen. The top right, bottom right and bottom leftscreen sub-windows W620 to W640 are configured similarly to the top leftscreen sub-window W610 and therefore will not be described in furtherdetail.

The projection operation sub-window W600 also has a PLAY button B601, aSTOP button B602, and a PAUSE button B603 to operate projection by theprojector PR1. These buttons are for collectively operating images sentto the projector PR1 from the moderator computer PCm. These buttons cancollectively carry out projection of images by the projector PR1, stopthe projection, or pause the images, regardless of whether the displayon the screen SC1 is split display or full-screen display.

The preview sub-window W700 is an area where, when the students A to Edisplayed in the participant display sub-window W520 are selected,preview of the display screen images PCT1 to PCT5 corresponding to theselected students A to E is shown regardless of the projected image bythe projector PR1. It is also possible to enlarge or reduce the displayby using an enlargement button B701 and a reduction button B702. In thispreview, for example, image data with a reduced data size are used whichare received from the computers PC1 to PC5 in response to a datatransmission request sent from the moderator computer PCm to thecomputers PC1 to PC5 when the students A to E are selected in theparticipant display sub-window W520.

The projector projection operation window W500 having these sub-windowsalso has a projector selection button B501 and a configuration buttonB502. The projector selection button B501 is a button to carry outselection of a projector and setting of the screen display again. Whenthis button is clicked, the projector selection window W400 isdisplayed. Therefore, while using the conference system 10, the teacherM can click the projector selection button B501 to have the projectorselection window W400 shown, and can select a projector or change thesetting of the screen display. The configuration button B502 is a buttonto carryout setting with respect to whether input history to theprojector PR1 is used or not.

When the projection selection button B501 is clicked as described aboveto have the projector selection window W400 shown and the setting of thedisplay screen is changed, the subsequently shown projector projectionoperation window W500 is changed in accordance with that change. Forexample, if an operation to change from the four-screen display to thetwo-screen display is carried out in the projector selection windowW400, the CPU 70 reads a GUI program corresponding to the two-screendisplay from the plural GUI programs stored on the hard disk drive 80and causes the projector projection operation window W500 having theprojection operation sub-window W600 including two screen sub-windows tobe displayed, as the processing at the GUI control unit 75. As describedabove, in the embodiment(s) where the screen sub-windows are caused tocorrespond to display forms such as color, shape and size of the splitdisplay screen, the projection operation sub-window W600 may be changedin accordance with the change in the display form.

The screen sub-windows W610 to W640 constituting the projectionoperation sub-window W600 may be configured to display a thumbnailprepared by the CPU 70 on the basis of image data to be displayed in thecorresponding split screen forming areas, stored in the RAM 88. Forexample, in the screen sub-windows W610 to W640, a display part to showa thumbnail may be provided at a position that does not obstruct thevarious buttons, or a translucent thumbnail prepared by reduction ofluminance signals may be superimposed on the various buttons. Thus, thecorrespondence between the split screen forming areas and the screensub-windows W610 to W640 may be easier to recognize and operations maybe carried out more easily.

Now, the operation O360 will be described again. The teacher M selects“student A” in the participant display sub-window W520 by using theabove GUI, then confirms the content of the display screen image PCT1displayed in the preview sub-window W700, and clicks the projectionbutton B613 in the top left screen sub-window W610. Similarly, theteacher M selects the students B to D, then confirms the contents of thedisplay screen images PCT2 to PCT4 displayed in the preview sub-windowW700, and clicks the projection buttons B623 to B643 in the top right,bottom right and bottom left screen sub-windows W620 to W640. Theseoperations are instruction operations to cause the projector PR1 toproject a quadrisected image including the display screen images PCT1 toPCT4 of the computers PC1 to PC4. These instructions are accepted by theCPU 70 as the processing at the combined image accepting unit 73.

When a split display instruction is accepted, the CPU 70 of themoderator computer PCm sequentially sends a data transmission request tothe computers PC1 to PC4 (step S300).

As the CPU 20 of the computers PC1 to PC4 receives the data transmissionrequest sent from the moderator computer PCm (S320), the CPU 20 sendsimage data of the display screen images PCT1 to PCT4 displayed in thedisplay 65 of each computer to the moderator computer PCm, as theprocessing at the data transmitting unit 21 (step S321). The image dataof the display screen images PCT1 to PCT4 are image data (for example,here, RGB image data) recorded in the VRAM 61 of the computers PC1 toPC4 when the data transmission request is received. The image data issent together with setting information of the graphic controller 63 thatis necessary to display the image data as an image. In theembodiment(s), however, where the graphic controller 63 of the computersPC1 to PC4, the graphic controller 113 of the moderator computer PCm andthe graphic controller 153 of the projector PR1 have a uniform setting,the setting information of the graphic controller 63 does not have to besent.

Having received the transmission from the computers PC1 to PC4, the CPU70 of the moderator computer PCm receives the image data of the displayscreen images PCT1 to PCT4 sent from each of the computers PC1 to PC4and stores the image data in association with the computer names intothe RAM 85, as the processing at the data communication control unit 71(step S301). Then, the CPU 70 generates combined image data thatrepresents a combined image of the display screen images PCT1 to PCT4 inthe RAM 85, as the processing at the image combining unit 72 (stepS302).

After generating the combined image data, the CPU 70 sends the combinedimage data of the display screen images PCT1 to PCT4 to the projectorPR1, as the processing at the data communication control unit 71 (stepS304).

In the projector PR1, the CPU 120 receives the combined image data ofthe display screen images PCT1 to PCT4 sent from the moderator computerPCm and stores the combined image data into VRAM 151, as the processingat the data receiving unit 121. The graphic controller 153 reads theimage data in the VRAM 151 and projects an image on the screen SC1 byusing the projecting unit 155 (step S340). Thus, a quadrisected screenshowing the display screen images PCT1 to PCT4 in the split screenforming areas SC11 to SC14, respectively, is displayed on the screenSC1, as illustrated in the left column in FIG. 9.

In at least one embodiment, the projector projection operation windowW500 is in a state as illustrated in FIG. 13. As illustrated in FIG. 13,“projecting” is shown in the participant display sub-window W520 as thestatus of the students A to D. In the projection operation sub-windowW600, “students A to D” are shown in the projection user display partsD611, D621, D631, and D641, respectively. In the preview sub-windowW700, the display screen image PCT4 corresponding to the student D isshown, who is the last to be selected in the participant displaysub-window W520.

In step S302 and step S304, the CPU 70 receives image data from all ofthe computers PC1 to PC4, generates combined image data, and then sendsthe combined image data. However, the CPU 70 may generate and sendcombined image data at predetermined timing. In the former embodiment,an image of quadrisected display is immediately displayed on the screenSC1. In the latter embodiment, images in the process of generating thequadrisected display image are sequentially displayed as well.

In order to let the student A explain the display screen image PCT1 inmore detail, the teacher M may operate the input system 101 to give aninstruction to switch the display form of the image projected on thescreen SC1 from the quadrisected screen of the display screen imagesPCT1 to PCT4 to the full-screen display of the display screen image PCT1of the computer PC1 (operation O361). Specifically, the teacher M clicksthe full-screen display button B615 in the top left screen sub-windowW610 in the projector projection operation window W500 displayed on thedisplay 115 of the moderator computer PCm.

In response to this instruction, in the moderator computer PCm, the CPU70 accepts the instruction, as the processing at the image switchingaccepting unit 74, and sends the image data of the display screen imagePCT1 recorded in the RAM 85 in association with the name of the computerPC1, to the projector PR1, as the processing at the data communicationcontrol unit 71 (step S305).

In the projector PR1, the CPU 120 receives the image data of the displayscreen image PCT1 sent from the moderator computer PCm and projects animage on the screen SC1 as in the above step S340, as the processing atthe data receiving unit 121 (step S341). As such, the display screenimage PCT1 is displayed as a full-screen image on the screen SC1, asillustrated in the left column in FIG. 9. In this manner, the student Ausing the computer PC1 may show, for example, the display screen imagePCT1 displayed as a full-screen image on the screen SC1 to the otherstudents and may give a detailed explanation about the display screenimage PCT1 while confirming its content on the display 65 of thecomputer PC1.

While the display screen image PCT1 is projected in the full-screendisplay on the screen SC1 and the student A is explaining the displayscreen image PCT1, the teacher M may operate the input system 101 togive an instruction to prepare combined image data by replacing thedisplay screen image PCT2 of the combined image data including thedisplay screen images PCT1 to PCT4, with the display screen image PCT5(operation O362). Specifically, the teacher M clicks the stop buttonB624 in the top right screen sub-window W620 corresponding to the splitdisplay area of the display screen image PCT2, in the projectorprojection operation window W500 displayed on the display 115 of themoderator computer PCm, and then selects “student E” in the participantdisplay sub-window W520 and clicks the projection button B823 in the topright screen sub-window W620. This operation is in preparation for splitdisplay of the display screen images PCT1, PCT5, PCT3 and PCT4 after theexplanation of the display screen image PCT1 is completed.

In response to this instruction, in the moderator computer PCm, the CPU70 accepts the instruction as the processing at the combined imageaccepting unit 73, then specifies the IP address of the counterpart withreference to the client name profile 82 and the hourly profile 83, andsends a data transmission request to the computer PC5 (step S306).

As the CPU 20 of the computer PC5 receives the data transmission requestsent from the moderator computer PCm (step S322), the CPU 20 sends theimage data of the display screen image PCT5 displayed on the display 65to the moderator computer PCm, as the processing at the datatransmitting unit 21 (step S323). The transmission of image data in thisstep S323 and in the above step S321 may be carried out in a compressedimage format such as, for example, JPEG in consideration of thecommunication load on the local area network LAN.

In response to the transmission from the computer PC5, the CPU 70 of themoderator computer PCm receives the image data of the display screenimage PCT5 sent from the computer PC5 and stores the image data into theRAM 85 in association with the computer name, as the processing at thedata communication control unit 71 (step S307). Then, from the imagedata of the display screen images PCT1, PCT5, PCT3 and PCT4 stored inthe RAM 85, the CPU 70 generates combined image data representing acombined image of the display screen images PCT1, PCT5, PCT3 and PCT4 inthe RAM 85, as the processing at the image combining unit 72 (stepS308).

When the explanation of the display screen image PCT1 by the student Ais finished, the teacher M may operate the input system 101 to give aninstruction to switch the display form of the image projected on thescreen SC1 from the full-screen display of the display screen image PCT1to the split screen (operation O363). Specifically, the teacher M clicksthe full-screen display button B615 in the top left screen sub-windowW610 in the projector projection operation window W500 displayed on thedisplay 115 of the moderator computer PCm.

In response to this instruction, in the moderator computer PCm, the CPU70 accepts the instruction as the processing at the image switchingaccepting unit 74, and sends the combined image data of the displayscreen images PCT1, PCT5, PCT3 and PCT4 recorded in the RAM 85 to theprojector PR1, as the processing at the data communication control unit71 (step S310).

In the projector PR1, the CPU 120 receives the combined image data ofthe display screen images PCT1, PCT5, PCT3 and PCT4 sent from themoderator computer PCm, as the processing at the data receiving unit121, and projects an image on the screen SC1 as in the above steps S340and S341 (step S342). As such, on the screen SC1, a quadrisected screenshowing the display screen images PCT1, PCT5, PCT3 and PCT4 in the splitscreen forming areas SC11 to SC14, respectively, is displayed as shownin the left column in FIG. 10. Thus, the screen switching processingaccording to at least one embodiment is complete.

In at least one embodiment, in response to a data transmission requestfrom the moderator computer PCm, the computers PC1 to PC5 send imagedata recorded in the VRAM 61 at the time of receiving the transmissionrequest, to the moderator computer PCm. However, the computers PC1 toPC5 are not limited to such a configuration. For example, the computersPC1 to PC5 may send image data recorded in the VRAM 61 to the moderatorcomputer PCm at periodic timing intervals. Alternatively, as anotherexample, the computers PC1 to PC5 may send image data to the moderatorcomputer PCm every time data in the VRAM 61 is rewritten. With suchconfigurations, every time the moderator computer PCm receives imagedata, the image displayed on the screen SC1 may be updated to the latestimage by the method in at least one previously described embodiment.Thus, even in the embodiment where there is a change in the displayscreen images PCT1 to PCT5 of the computers PC1 to PC5 or in theembodiment where the display screen images PCT1 to PCT5 are dynamicimages, the display screen images PCT1 to PCT5 may be displayed on thescreen SC1 while the change in the display screen images PCT1 to PCT5 isfollowed. When such configurations are employed, if the computers PC1 toPC5 sends only the rewritten data part, the communication load on thelocal area network LAN may be reduced.

In certain previously described embodiment(s), the display screen imagesPCT1 to PCT5 are projected on the screen SC1. However, it is alsopossible to project the display screen image PCTm of the moderatorcomputer PCm by selecting the teacher M in the participant displaysub-window W520 in the projector projection operation window W500. Inthis embodiment, the teacher M can display desired image data on thedisplay 115 and then minimize the projector projection operation windowW500.

In certain previously described embodiment(s), the images projected onthe screen SC1 are the display screen images PCT1 to PCT5 of thecomputers PC1 to PC5. However, the images to be projected are notlimited to these and can be any image that is handled by the computersPC1 to PC5. For example, in an embodiment where the computers PC1 to PC5are equipped with a web camera, images shot by the web camera may beprojected. Alternatively, designated image data, of image data stored ineach of the computers PC1 to PC5, may be projected without beingdisplayed on the display 65 of the computers PC1 to PC5.

In certain previously described embodiment(s), a projector is used asthe image display apparatus in conference system 10. However, variousdisplay devices such as, for example, a plasma display, liquid crystaldisplay and organic EL display may be used. Moreover, though thecomputers PC1 to PC5 are used as exemplary terminals in the conferencesystem 10, various communication terminals such as, for example, amobile phone and PDA (personal digital assistant) may be used.

In certain previously described embodiment(s), the moderator computerPCm functions as a server that receives image data from the computersPC1 to PC5, carries out processing such as generating a combined imageand sends the combined image to the projector PR1. However, themoderator computer PCm operated by the teacher M and a server may beseparately installed. As such, the load on the moderator computer PCmmay be reduced and the performance of the moderator computer PCm may beenhanced. Moreover, in such embodiment, the hourly profile 33 stored onthe hard disk drive 30 of the computers PC1 to PC5, and the hourlyprofile 83 and the class makeup profile 84 stored on the hard disk drive80 of the moderator computer PCm may be collectively managed by theserver. The computers PC1 to PC5 and the moderator computer PCm mayaccess the server every time the connection processing shown in FIG. 5and FIG. 6 is carried out, and then read a necessary profile. Of course,in the embodiment where the moderator computer PCm functions as aserver, the moderator computer PCm may collectively manage the profiles.As such, the timetables for the teacher M and the students A to E, themakeup of each class and the like may be collectively managed and may beeasier to manage.

The graphical user interface device used in the conference system 10 ofvarious previously described embodiments causes the display 115 todisplay the projection operation sub-window W600 having the same numberand layout of screen sub-windows as the split screen forming areas thatconstitute the split display screen displayed on the screen SC1. Assuch, by carrying out an operation using a screen sub-windowcorresponding to a split screen forming area where the user wants tocarry out the operation, it is no longer necessary to carry out anoperation to select the split screen forming area where the operation isto be carried out. Moreover, which screen sub-window is associated withwhich split screen forming area may be visually grasped more easily.Thus, operations such as allocation of images to the split screenforming areas SC11 to SC14 of the screen SC1 may be more easily carriedout.

The graphical user interface device used in the conference system 10 ofcertain previously described embodiments also causes the display 115 todisplay the projection operation sub-window W600 in which each of thescreen sub-windows W610 to W640 has the full-screen display button toswitch between split screen display and full-screen display. As such, byclicking the button in a screen sub-window corresponding to an imagethat is to be shown in full-screen display and thus giving aninstruction to switch the display on the screen SC1 from split screendisplay to full-screen display, it is no longer necessary to carry outan operation to select the image that is to be shown in full-screendisplay. As such, the display form may be more easily switched tofull-screen display with fewer operations.

The graphical user interface device used in the conference system 10 ofcertain previously described embodiments also causes the display 115 todisplay the projection operation sub-window W600 in which each of thescreen sub-windows has the projection button to allocate a predeterminedimage to the corresponding split screen forming area and the full-screendisplay button to switch between split screen display and full-screendisplay. As such, it is possible to allocate a predetermined image tothe split screen forming areas SC11 to SC14 while an image offull-screen display is shown on the screen SC1 as a result of clickingthe full-screen display button to switch the display on the screen SC1from split screen display to full-screen display. As such, at the timeof switching again from full-screen display to split screen display,relatively little or no waiting time is required due to an operation toallocate an image to the split screen forming areas. As such, it ispossible to more smoothly switch between split screen display andfull-screen display.

Moreover, in the graphical user interface device used in the conferencesystem 10 of certain previously described embodiments, when the numberof splits, layout or the like for the screen display on the screen SC1is changed by using the projector selection window W400, the number ofscreen sub-windows, their layout or the like in the subsequentlydisplayed projector projection operation window W500 is changed inaccordance with that change. As such, no matter what split screen hasits number of splits and layout changed, or even when the number ofsplits and layout are changed while the conference system 10 is beingused, the correspondence between the screen sub-windows and the splitscreen forming areas of the screen SC1 may be visually maintained, andoperations such as allocation of an image to the split screen formingareas may be more easily carried out.

Although certain embodiments have been described above, the disclosureis not limited to such embodiments. Various changes and modificationsmay be made without departing from the scope and spirit of thedisclosure. For example, while the moderator computer PCm is equippedwith the graphical user interface device in certain previously describedembodiments, the graphical user interface device may also be installedin a display device such as the projector PR1. Accordingly, those withskill in the art will readily appreciate that embodiments in accordancewith the present disclosure may be implemented in a very wide variety ofways. This disclosure is intended to cover any adaptations or variationsof the embodiments discussed herein. Therefore, it is manifestlyintended that embodiments in accordance with the present disclosure belimited only by the claims and the equivalents thereof.

What is claimed is:
 1. A graphical user interface device configured tocontrol a projector which displays a combined image including a firstarea and a second area, the graphical user interface device comprising:an image display device configured to display an operation windowincluding a first operation area which corresponds to the first area anda second operation area which corresponds to the second area; anallocation unit configured to allocate the graphical user interfacedevice to the first operation area, and to allocate one of a pluralityof participant devices to the second operation area; and a controllerconfigured to control the projector to display the combined image inwhich a first image, that corresponds to the image display device of thegraphical user interface device, is displayed in the first area and inwhich a second image, that corresponds to a participant device allocatedto the second operation area, is displayed in the second area.
 2. Thegraphical user interface device according to claim 1, wherein the firstoperation area and the second operation area are arranged in a samepositional relation as a layout of the first area and the second area.3. The graphical user interface device according to claim 1, furthercomprising a switching unit configured to switch at least one of thefirst image associated with the first operation area and the secondimage associated with the second operation area from being displayed onone of the first area and the second area in a split screen display tobeing displayed in a full-screen display.
 4. The graphical userinterface device according to claim 3, wherein the allocation unit isconfigured to permit selective association of a new image to the firstoperation area or the second operation area while the switching unit isswitching from displaying at least one of the first image or the secondimage in the split screen display to displaying the first image or thesecond image in the full-screen display.
 5. The graphical user interfacedevice according to claim 1, further comprising a unit configured todisplay a thumbnail of the first image in the first operation area, anddisplays a thumbnail of the second image in the second operation area.6. The graphical user interface device according to claim 1, furthercomprising: a unit configured to change at least one of a number ofsplit screen forming areas that includes the first area and the secondarea and a layout of the number of split screen forming areas; and aunit configured to change a number of operation areas that includes thefirst operation area and the second operation area in accordance withthe changed number of the split screen forming areas and change a layoutof the number of operation areas in accordance with the changed layoutof the split screen forming areas.
 7. The graphical user interfacedevice according to claim 1, further configured to: read a predefineddata set; upon receiving a connection request from a participant device,permit a connection if the participant device belongs to the predefineddata set; select at least two participant devices for display on theimage display device and assigning each of these participant devices toone of the first and second operation areas; receive image data fromeach of the at least two participant devices; combine the image datafrom the at least two participant devices to form the first and secondimages; and provide the first and second images for display on the firstand second areas.
 8. The graphical user interface device according toclaim 1, wherein the graphical user interface device is implementedwithin a personal computer.
 9. A conference system including: thegraphical user interface device of claim 1; and the projector displayingthe combined image including the first area and the second area.
 10. Thegraphical user interface device according to claim 1, further configuredto display to a user a list of participant devices that are connected tothe graphical user interface device and a status of whether image datafrom each of the participant devices is being transmitted to theprojector.
 11. The graphical user interface device according to claim 1,further configured to receive a selection of a projector for displayingthe first and second images on the image display device, and receiving aselection of a screen display setting for configuring the number offirst and second areas of the image display device.
 12. The graphicaluser interface device according to claim 1, wherein each of the firstand second operation areas have a colored window and each of the firstand second areas include a screen frame having a distinguishing color,each of the windows of the first and second operation areas having asame color as the color of the screen frame of the first or second areaassociated with the first or second operation area.
 13. A method forcontrolling a projector which displays a combined image including afirst area and a second area by a graphical user interface device, themethod comprising: displaying, on an image display device of thegraphical user interface device, an operation window including a firstoperation area which corresponds to the first area and a secondoperation area which corresponds to the second area; allocating thegraphical user interface device to the first operation area; allocatingone of a plurality of participant devices to the second operation area;and controlling the projector to display the combined image in which afirst image, that corresponds to the graphical user interface device, isdisplayed in the first area and in which a second image, corresponds toa participant device allocated to the second operation area, isdisplayed in the second area.
 14. The method according to claim 13,wherein the first operation area and the second operation area arearranged in a same positional relation as a layout of the first area andthe second area.
 15. The method according to claim 13, furthercomprising: switching at least one of the first image associated withthe first operation area and the second image associated with the secondoperation area from being displayed on one of the first area and thesecond area in a split screen display to being displayed in afull-screen display.
 16. The method according to claim 15, furthercomprising: permitting selective association of a new image to the firstoperation area or the second operation area while the switching unit isswitching from displaying at least one of the first image and the secondimage in the split screen display to displaying the first image or thesecond image in the full-screen display.
 17. The method according toclaim 13, further comprising: displaying a thumbnail of the first imagein the first operation area; and displaying a thumbnail of the secondimage in the second operation area.
 18. The method according to claim13, further comprising: changing at least one of a number of splitscreen forming areas that includes the first area and the second areaand a layout of the number of split screen forming areas; changing anumber of operation areas that includes the first operation area and thesecond operation area in accordance with the changed number of the splitscreen forming areas; and changing a layout of the number of operationareas in accordance with the changed layout of the split screen formingareas.
 19. The method according to claim 13, further comprising: readinga predefined data set; upon receiving a connection request from aparticipant device, permitting a connection if the participant devicebelongs to the predefined data set; selecting at least two participantdevices for display on the image display device and assigning each ofthese participant devices to one of the first and second operationareas; receiving image data from each of the at least two participantdevices; combining the image data from the at least two participantdevices to form the first and second images; and providing the first andsecond images for display on the first and second areas.
 20. The methodaccording to claim 13, further comprising: displaying to a user a listof participant devices that are connected to the graphical userinterface device and a status of whether image data from each of theparticipant devices is being transmitted to the projector.
 21. Themethod according to claim 13, further comprising: receiving a selectionof a projector for displaying the first and second images on the imagedisplay device; and receiving a selection of a screen display settingfor configuring the number of first and second areas of the imagedisplay device.
 22. The method according to claim 13, wherein each ofthe first and second operation areas have a colored window and each ofthe first and second areas include a screen frame having adistinguishing color, each of the windows of the first and secondoperation areas having a same color as the color of the screen frame ofthe first or second area associated with the first or second operationarea.
 23. The method according to claim 13, wherein the first image andthe second image are not displayed in the operation window.
 24. Themethod according to claim 13, further comprising: displaying, on theimage display device, a preview window that is separate from theoperation window, the preview window including at least one of the firstimage and the second image.
 25. A computer program product comprisinginstructions recorded on at least one non-transitory computer-readablestorage medium and executable by a computer to control a projector whichdisplays a combined image including a first area and a second area, theinstructions executable to perform: displaying, on an image displaydevice of the computer, an operation window including a first operationarea which corresponds to the first area and a second operation areawhich corresponds to the second area; allocating the computer to thefirst operation area; allocating one of a plurality of participantdevices to the second operation area; and controlling the projector todisplay the combined image in which a first image, that corresponds tothe image display device of the computer, is displayed in the first areaand in which a second image, that corresponds to a participant deviceallocated to the second operation area, is displayed in the second area.26. The computer program product according to claim 25, wherein thefirst operation area and the second operation area are arranged in asame positional relation as a layout of the first area and the secondarea.
 27. The computer program product according to claim 25, whereinthe instructions are executable to further perform: switching at leastone of the first image associated with the first operation area and thesecond image associated with the second operation area from beingdisplayed on one of the first area and second areas in a split screendisplay to being displayed in a full-screen display;
 28. The computerprogram product according to claim 27, wherein the instructions areexecutable to further perform: permitting selective association of a newimage to the first operation area or the second operation area while theswitching unit is switching from displaying at least one of the firstimage or the second image in the split screen display to displaying thefirst image or the second image in the full-screen display.
 29. Thecomputer program product according to claim 25, wherein the instructionsare executable to further perform: displaying a thumbnail of the firstimage in the first operation area; and displaying a thumbnail of thesecond image in the second operation area.
 30. The computer programproduct according to claim 25, wherein the instructions are executableto further perform: changing at least one of a number of split screenforming areas that includes the first area and the second area and alayout of the number of split screen forming areas; changing a number ofoperation areas that includes the first operation area and the secondoperation area in accordance with the changed number of the split screenforming areas; and changing a layout of the number of operation areas inaccordance with the changed layout of the split screen forming areas.31. The computer program product according to claim 25, wherein theinstructions are executable to further perform: reading a predefineddata set; upon receiving a connection request from a participant device,permitting a connection if the participant device belongs to thepredefined data set; selecting at least two participant devices fordisplay on the image display device and assigning each of theseparticipant devices to one of the first and second operation areas;receiving image data from each of the at least two participant devices;combining the image data from the at least two participant devices toform the first and second images; and providing the first and secondimages for display on the first and second areas.
 32. The computerprogram product according to claim 25, wherein the computer programproduct is implemented within a personal computer.
 33. A conferencesystem including: the computer program product according to claim 25;and the projector displaying the combined image including the first areaand the second area.
 34. The computer program product according to claim25, wherein the instructions are executable to further perform:displaying to a user a list of participant devices that are connected tothe graphical user interface device and a status of whether image datafrom each of the participant devices is being transmitted to theprojector.
 35. The computer program product according to claim 25,wherein the instructions are executable to further perform: receiving aselection of a projector for displaying the first and second images onthe image display device; and receiving a selection of a screen displaysetting for configuring the number of first and second areas of theimage display device.
 36. The computer program product according toclaim 25, wherein each of the first and second operation areas have acolored window and each of the first and second areas include a screenframe having a distinguishing color, each of the windows of the firstand second operation areas having a same color as the color of thescreen frame of the first or second area associated with the first orsecond operation area.
 37. The computer program product according toclaim 25, wherein the first image and the second image are not displayedin the operation window.
 38. The computer program product according toclaim 25, wherein the instructions are executable to further perform:displaying, on the image display device, a preview window that isseparate from the operation window, the preview window including atleast one of the first image and the second image.